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We analyze the equilibrium statistical mechanics of canonical, non-canonical and non-Hamiltonian 
equations of motion by throwing light into the peculiar geometric structure of phase space. Some 
fundamental issues regarding time translation and phase space measure are clarified. In particular, 
we emphasize that a phase space measure should be defined by means of the Jacobian of the 
transformation between different types of coordinates since such a determinant is different from 
zero in the non-canonical case even if the phase space compressibility is null. Instead, the Jacobian 
determinant associated with phase space flows is unity whenever non-canonical coordinates lead to a 
vanishing compressibility, so that its use in order to define a measure may not be always correct. To 
better illustrate this point, we derive a mathematical condition for defining non-Hamiltonian phase 
space flows with zero compressibility. The Jacobian determinant associated with time evolution in 
phase space is altogether useful for analyzing time translation invariance. The proper deflnition of a 
phase space measure is particularly important when deflning the entropy functional in the canonical, 
non-canonical, and non-Hamiltonian cases. We show how the use of relative entropies can circumvent 
some subtle problems that are encountered when dealing with continuous probability distributions 
and phase space measures. Finally, a maximum (relative) entropy principle is formulated for non- 
canonical and non-Hamiltonian phase space flows. 
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I. INTRODUCTION 

In this paper we address some general issues concern- 
ing the geometry of non-Hamiltonian phase space under 
the condition of thermodynamical equilibrium. In the 
field of classical molecular dynamics simulations, non- 
Hamiltonian formalisms have been developed in order to 
simulate numerically the effect of thermal and pressure 
baths on relevant subsystems bymeans of a finite number 
of degrees of freedom J,, ^ [1, It is also worth men- 
tioning that the non-Hamiltonian approach is the method 
of choice for path integral [s^ and ab-initio path integral 
molecular dynamics calculations [^). More recently, it 
has been shown that the theories 0, [1] needed to de- 
scribe in a consistent way the coupling between quantum 
and classical degrees of freedom are non-Hamiltonian in 
their very essence [q!, To] . Despite the ever growing num- 
ber of successful applications of non-Hamiltonian theories 
to molecular dynamics simulations, a clarification is de- 
sirable since classical non-Hamiltonian theories in phase 
space have been typically formulated by means of two dis- 
tinct approaches. In one case, phase space is considered 
as a Riemann manifold, endowed with a metric tensor 
whose determinant is used to define the measure of the 
volume element [ll|, Within this type of approach 
it is not clear how to derive non-Hamiltonian equations 
of motion but, once these are given, their statistical me- 
chanics is defined by introducing an invariant measure of 
phase space. As a matter of fact, the metric of phase 
space has been exclusively linked in Refs. [Ill UJ to 
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the phase space compressibility. However, there are sys- 
tems that, while being non-canonical, have a non-zero 
Jacobian and a vanishing compressibility. To show this, 
we derive a condition in order to define non-canonical 
and non-Hamiltonian systems with zero compressibility. 
Then, we argue that the phase space measure should be 
defined in terms of the Jacobian pertaining to the trans- 
formation between different types of coordinates (for ex- 
ample, canonical vs. non-canonical coordinates). This 
Jacobian should not be confused with another Jacobian 
determinant, that is associated with the transformation 
realized by the law of motion, and which arises naturally 
when addressing the time-translation property of statis- 
tical mechanics in phase space. 

Another approach to non-Hamiltonian statistical me- 
chanics has been proposed in Refs. It uses gener- 
alized antisymmetric brackets to define non-Hamiltonian 
equations of motion. A generalized Liouville equation 
for distribution functions in phase space can be written in 
such a way that its solutions naturally provide the statis- 
tical weight of phase space. In addition, linear response 
theory [ll,[l3| as well as extensions of the theory to quan- 
tum and quantum-classical mechanics [8] can be easily 
formulated. Such an approach has an algebraic structure 
whose distinctive feature is the violation of the Jacobi 
relation [l^, [l^, [13, It is important to note that 
the failure of the Jacobi relation implies the lack of time- 
translation invariance of the algebra Q . This means that 
if two arbitrary phase space observables obey a relation 
expressed by means of a generalized bracket at time t^, 
then, in general, such two observables will not satisfy the 
same relation at time t ^ tg. This leads to consequences 
in the proper definition of the constants of motion (for ex- 
ample, the generalized bracket of two constants of motion 
is not necessarily a constant of motion) and in the defini- 
tion of correlation functions. An example of the applica- 
tion of a similar philosophy to address non-Hamiltonian 
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phase space can be found in Ezra's work [l9|, |20| , where 
the elegant formahsm of differential forms and exterior 
derivatives has been used. More recently, such an ap- 
proach has been re-expressed using the antisymmetric 
matrix structure introduced in Refs. (isl . [l^ in order to 
devise measure-preserving algorithms for the numerical 
integration of non-Hamiltonian equations of motion 2l| . 

Another issue that is particularly relevant for non- 
Hamiltonian statistical mechanics is the covariant def- 
inition of the entropy functional. When dealing with 
non-canonical and non-Hamiltonian systems with zero 
compressibility, care must be payed because, as discussed 
above, the conclusion that the measure is trivial may be 
erroneous [ll|, Instead, the phase space Jacobian, 

which is different from unity whenever non-canonical co- 
ordinates are adopted, should be used to define the cor- 
rect measure of phase space and the covariant entropy 
functional. However, such a functional, as already dis- 
cussed in Refs. [2^, [2J,[23], can be defined without any a 
priori knowledge of the metric factor. The key point is 
that relative entropies are called for when dealing with 
continuous probability distributions. In fact, a relative 
entropy functional naturally accounts for unknown met- 
ric factors. Therefore, a maximum entropy principle can 
be introduced for non-canonical and non-Hamiltonian 
dynamics. 

Since the (relative) entropy production is trivially null 
under the condition of thermodynamical equilibrium, a 
comment is called for. Indeed, it is worth underlining 
that, while presenting results that aim at clarifying the 
nature of non-Hamiltonian equilibrium geometry, we also 
intend to set the pre-conditions to cope with the non- 
equilibrium case within an information theoretical per- 
spective (for a general introduction see Ref. [1^ and ref- 
erences contained therein). Within such a framework, it 
is not really important to describe the fine-grained com- 
plexity of phase space under non-equilibrium conditions: 
what matters is the ability to identify the statistical con- 
straints which allow one to perform calculations with a 
predictive value. 

This approach is different from another approach to 
non-equilibrium statistical mechanics [1^ which, instead, 
aims at describing in a complete way the fine-grained 
complexity of phase space out of equilibrium. This lat- 
ter approach has led, in recent years, to some important 
achievements such as the discovery of the fractal nature 
of phase space in non-equilibrium steady states [27j and 
an analysis of some interesting statistical models such as 
Anasov's systems |2^. However, these systems are dif- 
ferent from those investigated by chemical physics (see 
[29| for some recent examples). However, we believe that 
looking at the fine-grained nature of phase space or in- 
voking information theoretic techniques should not be 
considered as mutually exclusive paths of investigation. 

Clarifying the above issues is not the only goal of this 
paper. For an easier reading of the paper, we anticipate 
the results we shall illustrate in the following: 

(i) We derive the conditions for obtaining a class of 



non-Hamiltonian phase-space flows with zero com- 
pressibility. 

(ii) Given that the compressibility is not a critical fea- 
ture of non-Hamiltonian phase-space flows, we in- 
troduce a more proper definition of the phase-space 
measure by means of the Jacobian of the coordinate 
transformation. 

(iii) We show that using the Jacobian determinant 
Jit, to) that is associated with the equations of 
motion in order to define the phase-space measure 
can be misleading when the compressibility van- 
ishes. We also show that this determinant is rele- 
vant for the invariance properties of the statistical- 
mechanical averages with respect to time transla- 
tion. 

(iv) Wc introduce a maximum-entropy approach for 
non-Hamiltonian systems. 

(v) We adopt the concept of relative entropy in order to 
ensure covariance in phase space. As a by-product 
of this analysis, we prove that Ramshaw's covariant 
entropy [23j is actually a relative entropy. 

The paper is divided into two main sections. 

Section treats the peculiar geometry of phase space 
and its influence on dynamics and statistical mechan- 
ics. In Sec. Ill Al the canonical Hamiltonian phase space 
is briefly reviewed. The geometry of canonical phase 
space and its statistical mechanics are shortly discussed 
by means of Poisson brackets. The invariance of equilib- 
rium statistical mechanics under time translation is dis- 
cussed. Section Hi Bl generalizes the result of Sec. Ill Al to 
non-canonical Hamiltonian phase space flows by employ- 
ing non-canonical brackets. Section [II CI shows that non- 
Hamiltonian statistical mechanics is not time-translation 
invariant. Conditions in order to obtain non-Hamiltonian 
phase space flows with zero compressibility are also de- 
rived. Appendices El and |B] provide examples of simple 
non-canonical and non-Hamiltonian dynamics with zero 
compressibility. 

Section IIIII is devoted to a discussion of the relative 
entropy functional, of its covariance, and of a formula 
for its production rate. In Sec. IIII Al the covariant rela- 
tive entropy is illustrated and is used in order to derive 
a "maximum relative entropy" principle. Such results 
are extended to the non-canonical and non-Hamiltonian 
cases in Sec. IIII I3l A formula for the rate of production of 
the relative entropy is derived in Sec. IIII CI Concluding 
remarks are given in Sec. IIVI 



II. GEOMETRY OF PHASE SPACE 
A. Canonical Hamiltonian Phase Space 

Let X = {q,p) denote a point in phase space, where q 
and p are generalized coordinates and momenta, respec- 
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tively. Let Ti,{x) be the (Hamiltonian) generalized energy 
function of the system. We consider, here and in the 
foUowing section, only the case in which is time- 

independent. Let 2n be the dimension of phase space. 
Then, the 2n x 2n antisymmetric matrix S'*, or cosym- 
plectic form [H, [H, [TtI, [lH , reads as 



1 
1 



(1) 



Correspondingly, the canonical Hamiltonian equations of 
motion are given by 



dH 



(2) 



for i = 1, . . . , 2n. Equations ^ can be derived from a 
variational principle in phase space [s^ applied to the 
action written in symplectic form 



dt 



2n 



H 



The compressibility of phase space 



(3) 



E 



dxj 
dxi 



^ dBf^ dH 



i,3 = l 



dxj dxi 



(4) 



is zero because the matrix is constant. Poisson brack- 
ets can be defined as 



2n 



(5) 



where a{x) and b[x) are arbitrary phase space functions, 
so that the equations of motion follow in the form 

Xi = {xi,'H}b- ■ (6) 

The Jacobi relation 

{a, {6, c}s= }b= + {c, {a, b}^- }b- + {b, {c, a}e- }b= = (7) 

is satisfied as an identity in canonical coordinates: 

{x,,x,}BS^Bt^. (8) 

It is well-known that Poisson brackets can be used to 
realize infinitesimal contact transformations [l^, [l^ . 
In particular 



fq^ {... ,p}B-Sq 



(9) 



is the operator realizing infinitesimal translations along 
the q axis and 



-{..., g}s.(5p 



(10) 



is the corresponding operator along the p axis (carrying 
infinitesimal changes of the generalized momenta). As 
a matter of fact, it can be easily verified that Tqa{x) = 
{da/dq)Sq and Tpa{x) = {da/dp)6p. It is also easy to 
verify that, because of the canonical relations in ([H]), 
translations along the axis of different generalized coor- 
dinates, positions and momenta, commute. This means 
that canonical phase space is flat even if generalized co- 
ordinates are used and even if the Lagrangian manifold 
from which one builds phase space is a Riemann mani- 
fold tie,]. 

In order to highlight the novel features which come 
into play in the formalism of the non-Hamiltonian case, 
we think it useful to sketch briefly the equilibrium sta- 
tistical mechanics of Hamiltonian canonical systems in a 
form that can be easily generalized to the non-canonical 
and non-Hamiltonian cases and that, by clearly distin- 
guishing between the Jacobian J^{x) and the Jacobian 
determinant J^(t, to), is also suited to discuss time trans- 
lation invariance. 

It is well known that the Liouvillc operator can be 
introduced using Poisson brackets, iL — {. . . , H}b^ . The 
Liouville equation for the statistical distribution function 
in phase space is written as [3l| : 



dp{x) 

at 



'iLp{x) . 



(11) 



In Equation pT|) . the function p{x) — J'^°''^j{x) has been 
introduced, where J(x) is the true distribution function 
in phase space and J'^"-'^ = 1 is the Jacobian of transfor- 
mations between canonical coordinates. In the canonical 
case, the identity p{x^ = /(x) trivially follows; however, 
this notation will turn out to be convenient later. By 
means of the Liouville operator one can introduce the 
propagator exp[itL] = exp[ii{. . . , 7Y}p] whose action is 
defined by 



a(x(f)) — exp[iti]a(a;) 



(12) 



where x without the time argument denotes its value at 
time zero. Statistical averages are calculated through 



(13) 



{a(x)) — J dxp{x)a{x) , 
and correlation functions as 

{ab{t)) — I dxp{x)a{x) eyiY>[itL]b{x) 



(14) 



We recall that in both Eqs. and the averag- 
ing over phase space coordinates is done by considering 
the coordinates calculated at the initial time. Indeed, 
the law of motion which carries a;(0) into x{t) is another 
transformation of coordinates 

dx{Q) = J{t,0)dx{t) , (15) 

where the Jacobian determinant satisfies the condition 

,dx{Q). 



dx{t) 



1 



(16) 
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At equilibrium 

Peg(t)=e-*^VegW=Pe, = 0, (17) 

and 

(a{x)} = {aixm . (18) 

The derivation of an analogous result for the correlation 
functions is more subtle and will permit us to make later 
important distinctions with the non-Hamiltonian case. 
In the Hamiltonian canonical case, we get from Eq. p^ : 



{ab{t)) — I dxpeq{x)a{x)h{x{t)) 

dx{t)p,q{x{t)) [e-'*^a(a;(t))] b{x{t)) 



= / dx{t)p,q{x{t))a{x{t))e'^%x{t)) . (19) 



(20) 



We consider the special case in which 

6(x(0)) = {c(x(0)),d(a;(0))},, 



where c(x) and d{x) are two arbitrary phase space func- 
tions. It is easy to prove, that if the Jacobi relation ([7]) 
holds, then 



itL 



{c{xm,d{x{m.^ = {c{x{t)),d{x{t))}^ 



(21) 



Hence, it follows: 

(a {x) {c{x{t)),d{x{t))}^^) 

dx{t)peqix{t))a{xit))e''^ {c{xit)), dixit))} ^ 



dxit)peqixit))aixit)) {c(a;(2t)), d(x(2t))}g, 
(a(.x(t)){c(x(2t)),d(a;(2t))},.) . (22) 



Equation (j22p shows that, at equilibrium and in the 
Hamiltonian canonical case, correlation functions are in- 
variant under time translation. We remark that the Ja- 
cobi relation ([7]) is necessary to derive this result so that 
it can be easily foreseen that in the non-Hamiltonian case, 
where the Jacobi relation no longer holds, this property 
of time-correlation functions is no longer verified. 



B. Non-canonical Hamiltonian Phase space 

Let us consider a transformation of phase space coor- 
dinates z = zix) such that the Jacobian 



J 



dx 
dz 



(23) 



Coordinates z are called non-canonical. The Hamiltonian 
transforms as a scalar Tiixjz)) = 'H' iz) and the equations 
of motion become [H, [l3| 



2n 



^Smfe(^)^— 
k=l "^'^ 



(24) 



where 



2n 



(25) 



Equations of motion can also be obtained by means of 
the variational principle [30] which arises when applying 
the non-canonical transformation of coordinates to the 
symplectic expression of the action given in Eq. ^ . One 
obtains the following form for the action in non-canonical 
coordinates |30|]: 



A 



dt 



E 

■i,j,m— 1 



dxj 

dZrr, 



z^Bl^x,iz)-n'iz) 



, (26) 



on which the variation is to be performed on the z co- 
ordinates in order to obtain Eqs. (|24p . Poisson brackets 
become non-canonical brackets defined by 



{a',b'} 



2n 

E 



'^'^'^B.,iz)'''^'^ 



dzi 



dzj 



(27) 



where a'(z) = a(a;(z)). Non-canonical equations of mo- 
tion can be expressed by means of the bracket in Eq. ([TT]) 
as Zi — {zi, 7i'(z)}s. With a little bit of algebra, one can 
verify that non-canonical brackets satisfy the Jacobi re- 
lation as an identity. The Jacobi relation leads to the 
following identity for Biz): 

Q f.\ \^(k ^^Mll.K dB^jiz) 
S^Jkiz) - 2^ [ Ba + Bki 



1=1 



dz. 



B 



d Bk^iz) 
dzi 



'ji- 



. 



(28) 



The non-canonical brackets of phase space coordinates 
are given by 



{zi,Zj}s = Bi-iiz) 



(29) 



Upon identifying the phase space point as z = (^, C), one 
can define the operators 



T, = {... 



(30) 
(31) 



which realize infinitesimal translations along the axes ^ 
and C. The non-canonical bracket relations of Eq. P5|) 
imply that translations along the phase space axis in gen- 
eral do not commute or, in other words, phase space is 
curved. Notice we do not need to introduce a metric 
tensor. One just has to introduce parallel transport and 
an affine connection, which can be implicitly defined by 
means of the non-canonical brackets and of the infinites- 
imal translation operators and T^. 

Non-canonical phase spaces are obtained by means of 
a non-canonical transformation of coordinates applied to 
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canonical Hamiltonian systems. Suppose that there is a 
system with a non-canonical bracket satisfying the Ja- 
cobi relation or its equivalent form given in Eq. psp . 
Suppose also that detB ^ 0. Then, by means of Dar- 
boux's theorem the system can be put (at least locally) 
in a canonical form. One would classify such a system as 
Hamiltonian: following Refs. we think that this 

property follows from the validity of the Jacobi relation. 
In other words, if the algebra of brackets is a Lie algebra, 
then the phase space is Hamiltonian p^. 

For non-canonical systems, statistical mechanical av- 
erages can be calculated as 



(a'(z)) = / dzp{z)a'{z{t)) 



where 



piz) = Jiz)f'iz) , 



(32) 



(33) 



the Jacobian J^{z) being defined in Eq. ((23|) . The Liou- 
ville operator is defined by means of the non-canonical 
bracket 



iL' = {..., n'{z)}^ , 
while time propagation is given by 



(34) 



a'{z{t)) = exp[itL']a'{z) 

= exp[it{...,H'{z)}^]a'{z) . (35) 



In non-canonical coordinates a compressibility 

2ri 



k{z) = 



dB,j{z) dn'iz) 



i,3 = l 



dzi dz 



(36) 



might, but not necessarily, be present (see Appendix YK\ 
for a simple example of a non-canonical system with zero 
compressibility). Integrating by parts Eq. ([5^ . one ob- 
tains 

(a'(z)} = dz a' {z) eyip[-t{iL' + k{z))]p{z) . (37) 



Equation (|37[) implies that p{z) obeys the non-canonical 
Liouville equation 



dp{z) 
dt 



= -{iL' + k{z))p{z) 



2n 



d 



(38) 



It is easy to see that dMiz) = J{z)dz provides the cor- 
rect invariant measure [30|: 

= "l^millflyll , (39) 



where we have used the fact that the phase space flow in 
the X coordinates is canonical so that ||9a;(t)/92;(0)l| = 1. 
The use of the Jacobian provides the correct way of defin- 
ing the invariant measure because it can also be applied 
when there is no compressibility [30]. However, the cal- 
culation of averages, correlation functions and linear re- 
sponse theory does not require the invariant measure ex- 
plicitly. The Knowledge of p{z) is enough for statistical 
mechanics even in the non-Hamiltonian case and in the 
presence of constraints, as shown in Refs. [1, [T^, . 

It is interesting to analyze the time-translation invari- 
ance of non-canonical statistical mechanics. Under time 
evolution, the phase space volume element transforms as 



dz(0) = J{t,Q)dz{Q) , 

where the Jacobian determinant 

,dz{Q). 



Jim 



dz{t) 



(40) 



(41) 



is different from unity if and only if the compressibil- 
ity K is different from zero. As the simple example de- 
veloped in Appendix El shows, one can also have non- 
canonical equations of motion with zero compressibility. 
However, for the sake of comparison with the papers cited 
in Ref . , we shall explicitly consider the case in which 
K ^ so that J{t, 0) = — dt' K{t'). In this case and at 
equilibrium 

(a(z(0))) = I dz{0)p,q{z{0))a{z{Q)) 



dz(t)J(i,0)peg(^(0)) [e-'*^a(z(t))] 



The law of evolution of the Jacobian in Eq. ([1T|) is: 



Now, let 



dw{x{t)) 
Jt 



K{x{t)) 



(42) 



(43) 



(44) 



From Eq. (|43p it can be seen that the function w, which 
is the primitive function of k, certainly exists. Then, the 
Jacobian determinant can be written as 

J(t,0) = e-"'(^(*»e'"(^(°» . (45) 

The equilibrium distribution function follows as 

Peq{zm = ^"'e-^"(°)(5 (H(z(0)) - C) (46) 

Then, substituting Eqs. ^ and (gS]) into Eq. dH]), we 
obtain: 

(a(z(0))) 

= / dz(t)e-(-(*))^^^Ml^ [e-'*^a(z(i))] 



d^(i)e-(-W)^MiM:i^ [e-**^a(z(t))] , 



(47) 
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where the second equahty follows because the Hamilto- 
nian is conserved under time evolution. Then, upon in- 
tegrating by parts, one obtains: 

(a(z(0))) = I dz{t)p,,{t)a{z{t)) = {a{z{t))) . (48) 

Equation (|48| shows that phase space averages are time- 
translation invariant in the non-canonical statistical me- 
chanics of systems at equilibrium. Consider now the time 
correlation function 



{a{h{t),c{t)}^) = j dz{Q)p,,{Q)a{zm{h{t),c{t)}^ 

= J dz(^)e-"'(*)e'"(°)e-"'('')(5(?^(0)-C) 
X e-^^'a{z{t)){b{t),c{t)}^ 

dz{t)p,g{t)a{z{t))e''^'{b{t),c{t)}^ 



= J dz{t)p,g{t)a{z{t)){b{2t),c{2t)}^ 
= {a{t){b{2t),c{2t)}J , (49) 

where the last equality arises again from the validity of 
the Jacobian relation ([T])- Equation (j49| shows that, 
when the bracket satisfies the Jacobi relation, the equilib- 
rium statistical mechanics is invariant under time trans- 
lation. We would like to recall that an algebra expressed 
by brackets satisfying the Jacobi relation is a Lie alge- 
bra. Therefore, it is reasonable to consider a phase space 
theory observing such a property as Hamiltonian. 



C. Non-Hamiltonian Phase Space 

In Refs. [H, it was shown how non-Hamiltonian 
equations of motion, brackets and statistical mechanics 
can be defined. One must simply keep the generalized 
symplectic structure of the non-canonical equations in 
Eq. ([24|) and of the non-canonical bracket in Eq. (|27|) 
and use, in place of B{z), an antisymmetric matrix B{z). 
The matrix 13 (z) can be chosen arbitrarily, with the only 
constraint of being antisymmetric so that the Hamilto- 
nian is conserved. As a result the Jacobi relation may 
not be satisfied fl^. When this happens, one of the con- 
ditions of validity of the Darboux's theorem fails so that 
non-Hamiltonian phase space flows cannot be put into a 
canonical form. The failure of the Jacobi relation implies 



e'^*{a(0),6(0)}^^{a(0,6(i)}^ 



(50) 



Hence, even if the non-Hamiltonian theory has a vanish- 
ing compressibility, the equilibrium statistical mechanics 
is not time translation invariant. To show this, we note 
that: 



(WO), 6(0)}^) 



dmpeMHo),bm^ 



+ \ dz{t)Peg{t){a{t),bit)}^ (51) 



because of Eq. (|50|) . 

We consider the lack of time translation invariance to 
be the crucial feature of non-Hamiltonian statistical me- 
chanics. 



1. Non-Hamiltonian equations of motion with no phase 
space compressibility 

It is easy to realize that there are non-Hamiltonian 
phase space flows {i.e., flows defined by brackets which 
do not satisfy the Jacobi relation) with zero compress- 
ibility. We refer the reader to Appendix |B] for a triv- 
ial example. In order to show how this is possible, we 
consider a particular sub-ensemble of non-Hamiltonian 
phase space flows, viz., those flows that can be derived 
by means of a non-integrable scaling of time. Interest- 
ingly, it was Nose who originally considered this type of 
flows when he introduced his celebrated thermostat 0,3- 
Nose started with a canonical Hamiltonian system and 
then performed a non-canonical transformation, followed 
by a non-integrable scaling of time. Accordingly, we con- 
sider the non-integrable scaling of time 



dt = $(z)dr 



(52) 



where r is an auxiliary time variable. Such a scaling of 
dt is clearly non-integrable because, due to the depen- 
dence of dt on phase space coordinates, the integral / dt 
depends on the path in phase space. If we apply this scal- 
ing to Eq. ([M]) , we obtain the following non-Hamiltonian 
equations: 



dr 



j=i J 



2n 



dH'{z) 



(53) 



Using the antisymmetric matrix B as defined in Eq. (|53p , 
one can introduce a non-Hamiltonian bracket 



2n 



(54) 



This bracket does not satisfy the Jacobi relation so that 
the equations of motion ([53]) are non-Hamiltonian. In 
this case, there is a non- vanishing tensor associated with 
the Jacobi relation: 



2n 



i=\ 



dzi 



-Bki{z)- 



dzi 



(55) 
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The compressibility of the non-Hamiltonian equa- 
tions ((55|) is given by 



KiZ 



_ ^ d{dz^/dT) _ ^ dB^j dn'iz) 
' ~ ^ dz, ~ ^ 



4=1 

2n 

E 

i=l 



dz, 
dzi dt 



dzi dz. 



^{z)k{z) 



(56) 



where dzi / dt and k are given by the non-canonical equa- 
tions of motion prior to the non-integrable time-scaling. 
It is evident that whenever one chooses ^(z) in such a 
way that 



2n 

E 

i=l 



91n$(z) dzi 
dzi dt 



-k{z) 



(57) 



non-Hamiltonian flows have vanishing compressibility 
(see the trivial example given in Appendix [B]). Cor- 
respondingly, when the scaling is chosen according to 
Eq. (j57p . the distribution function will obey a non- 
Hamiltonian equation without a compressibility: 



dm 

dr 



= -{~p,n'{z)}^^-iL~p{z) . (58) 



III. RELATIVE ENTROPY 
A. The Hamiltonian case 

As is well known, the definition of the entropy func- 
tional for systems with continuous probability distribu- 
tion, needs a special care. We review, for the reader's 
convenience, some relevant definitions which hold for the 
Hamiltonian case and which we plan to generalize to non- 
Hamiltonian systems in the following sections. 

In order to be rigorous, one first assumes that phase 
space can be divided into small cells of volume A*^*) so 
that the coordinates in the i-th cell are denoted as x^'^. 
This way, phase space is effectively discretized and so is 
the distribution function: p{x^^^) = p*-*^. The absolute 
information entropy can be defined as [l^, [s^l : 



(59) 



where is Boltzmann's constant. The continuous limit 



S[p]= lim (-fcsypWlnpW) 



(60) 



diverges. Upon subtracting the divergent contribution, 
— fclnA*^*\ one obtains the finite expression 



S[p] — —ks J dxp{x)hip{x) 



(61) 



However, as discussed in Refs. [22, l23|, |2J|, the defini- 
tion given in Eq. (|6ip is not acceptable because it is not 
coordinate independent. 

When studying continuous probability distributions, 
one should use t he relative entropy, which is a measure of 
the information 2J| relative to a state of ignorance (rep- 
resented by a given distribution function). If one denotes 
this latter distribution by p{x), the relative entropy reads 
as 



Srei [p] = -ks J dxp{x) In 



p{x) 



(62) 



For canonical Hamiltonian systems, a convenient distri- 
bution function with respect to which one can define the 
relative entropy, is given by the distribution representing 
the state of absolute ignorance, i.e., the uniform distri- 
bution. Then, one can set p{x) = 1, so that, in practice, 
Srei[p\ in Eq. ((62)) coincides with the absolute entropy 
S[p\ in Eq. ([6T|) . However, it must be realized that a 
uniform distribution in canonical coordinates does not 
necessarily transform into another uniform distribution 
if more general coordinates (for example non-canonical) 
are used. Instead, the integral in Eq. is well defined 
and its value does not depend on a specific choice of co- 
ordinates. For example, considering the transformation 
X —>■ y, one has: 



dxp{x) In 



p{x) 



dyp'{y) In 



p'jy) 



(63) 



where dxp{x) = dyp'{y) and dxp{x) — dyp'{y). 

The relative entropy Srei[p] in Eq. (p^ is a measure 
of missing information and can be used as the starting 
point of a maximum entropy principle in order to obtain 
the form of the least biased or maximum non-committal 
distribution function p{x). To this end, upon considering 
the two statistical constraints (H) = E and / dxp{x) = 1, 
one is led to consider the quantity 



J = Srei[p] +X{E~ (H)) + 7 1 - / dxp{x) 



(64) 



where two Lagrangian multipliers (A and 7) have been 
introduced. Upon maximizing I with respect to p{x), 
the following expression for p{x) is easily recovered: 



p{x) — Z ^p{x) exp 



ks 



n{x) 



(65) 



where Z = J dxp{x) e^Tp[—{X/kB)'H{x)]. Equation (I65p 
generalizes the standard maximum entropy principle [32l | . 
to the case of the relative entropy of continuous proba- 
bility distributions. In the canonical Hamiltonian case, 
which has been treated in this section, p{x) is trivially 
the uniform distribution. However, for non-canonical and 
non-Hamiltonian phase space p{x) plays a fundamental 
role. 
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B. Non-canonical and non-Hamiltonian relative 
entropy 

In the non-canonical and non-Hamiltonian case a Ja- 
cobian enters the definition of the phase space volume 
element. Accordingly, one should write a coordinate- 
independent entropy functional as 



S,, 



dzj{z)f'{z)\nf'{z) 



dzp(z) In 



(66) 



This expression is recovered starting from the relative en- 
tropy. An intrinsic (coordinate-free) form of Eq. (j66p has 
been given in Ref. [20|. In order to see this, one just needs 
to transform Eq. (|62p into non-canonical coordinates: 



^{x)dx = \ ■ dx — J{z)dz (67) 
f{x)dx = f{z)J{z)dz = p{z)dz . (68) 

so that Eq. ([55]) naturally follows. If the Jacobian J{z) 
is not known, one can use any other distribution func- 
tion with respect to which the entropy is calculated, 
i.e., m{x)dx = m'{z)J'{z)dz. Let us define fi{z) = 
m' {z)J{z), in analogy with p{z) = f'{z)J{z). One can 
think of ii{z) as the solution of a Liouville equation with 
different interactions. For example, if iL' = iL'^ + iL'j, 
one may define fi{z) as the solution of the equation 



dfi{z) 
dt 



-{iL'„ + Kn)fi{z) , 



(69) 



with K ~ kq + Kj. The entropy determined by the ad- 
ditional interactions, represented by iL'j, with respect to 
the state where the term iL'j is absent, is given by 



Srei[p\fA = J dzp{z) In 



P(f) 
piz) 



(70) 



Equation ([70| , with the correct interpretation of the dis- 
tribution function p{z), provides a coordinate-invariant 
definition of the relative entropy which does not require 
the explicit knowledge of the metric as well as of the Ja- 
cobian. The maximum-entropy principle, as written in 
the previous section for the canonical case, also applies 
without major changes to the non-canonical and non- 
Hamiltonian dynamics. The functional to be maximized 
is 

I=Srel[p\p]+\iE-{n'iz)))+-f(^l- J dzpiz)^ , 

which provides, by setting 62/Sp{z) ~ 0, the generalized 
canonical distribution in non-canonical coordinates 



P(^) = V(2) exp 



-Ah'(z) 



(71) 



The quantity — J (iz/x(z) exp[— (A/fcB)W(z)] is a 
weighted partition function. 



C. Relative entropy production 

In order to simplify the notation, we rewrite the Liou- 
ville equation as 



dp{x, t) 
dt 



-V • [px) 



(72) 



where we have introduced an obvious vectorial notation 
(to avoid indices) and V = 9/92: is the operator of differ- 
entiation with respect to phase space coordinates. From 
the relative entropy functional 



S ~ —kB j dxphi{^ ^ p) , 
the entropy production follows as 

S = -ks J [-V • (pi) ln(7- V) 



(73) 



-I- 7 (7 ^dtp - pj ^dtl) 



(74) 



The term J dxdtp vanishes because of the normalization 
condition on p. Hence 

S = -ks J dx[px-V\n{-f-^p)- p-f-^da] . (75) 

The entropy production can then be put in the form 



S 



ksil ^da) - ks I dxpx . I ^ - — ) .(76) 



P 
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We can show that Eq. ([75]) coincides with the formula 
of the covariant entropy production formerly given by 
Ramshaw [111 when 7 = pf^^ ■ To this end, upon noting 
that 



(77) 



we obtain: 



/dxpx ■ \ — -^1 
P 7 



In the general case, we obtain from Eq. ([76 
,1 fd-i 



S = kB{^\^+±-V-i]) + kB{K) 



dxpj^'^V ■ (jx) .(78) 



(79) 



(80) 



and upon noting that 

f 1 
(k) = / dxp— (7V • x) . 
J 7 

the relative entropy production can be written as 

S = kB{io{x,t)) , (81) 

where 



U!{x, t) — — 

7 



| + V.(7i) 



(82) 
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Equation (I8ip is identical to the covariant entropy pro- 
duction given by Ramshaw [2^. Ezra [l^l has also pro- 
vided a coordinate-free expression of Eq. ([8T|l . Such com- 
parisons are presented to validate our information theo- 
retical approach to non-Hamiltonian systems at equilib- 
rium. When a; = 0, i.e., if 7 is a solution of the Liou- 
ville equation, then = 0. It is also clear that in an 
equilibrium ensemble {dtp — 0, dtf — 0, dtj = 0) the 
production of (relative) entropy is trivially null. 



dynamical ensembles. 
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APPENDIX A: A NON-CANONICAL SYSTEM 
WITH ZERO COMPRESSIBILITY 



Consider the following simple Hamiltonian 



IV. CONCLUSIONS 

The geometry of phase space is peculiar. Antisymmet- 
ric brackets, which define a Lie algebra (in the canon- 
ical and non-canonical cases) or a non-Lie algebra (in 
the non-Hamiltonian case), can be used to connect, by 
means of infinitesimal "contact" transformations, nearby 
points over the manifold. A distinctive feature of non- 
Hamiltonian equilibrium statistical mechanics is the lack 
of time-translation invariance. This is mathematically 
represented by the failure of the Jacobi relation. As a 
matter of fact, whenever a bracket satisfies the Jacobi 
relation, the equilibrium statistical mechanics is time 
translation invariant and the bracket realizes a Lie al- 
gebra. We surmise that such theories should be classified 
as Hamiltonian. 

We argue that a non-vanishing phase space com- 
pressibility is not a signature of non-canonical or non- 
Hamiltonian dynamics. There are cases (and it is worth 
noting that Andersen's constant pressure dynamics [l| 
is one of these) where the compressibility is zero but 
the Jacobian is not unity and the dynamics is non- 
canonical (or non-Hamiltonian). In particular, we have 
derived a condition for having a vanishing compressibil- 
ity in a restricted class of non-Hamiltonian phase space 
flows (those flows which are obtained by means of non- 
canonical transformations of coordinates followed by a 
non-integrable scaling of time [2,, JJ). In such cases, it is 
obvious that the measure of phase space cannot be de- 
rived from the phase space compressibility. Instead, one 
should use the Jacobian of the transformation between 
different types of phase space coordinates. However, it 
is not necessary to know explicitly such a Jacobian for 
setting up a statistical mechanical theory. In fact, the 
distribution function and the Liouville operators are suf- 
ficient to this end. 

We remark how, for continuous probability distribu- 
tions, one should use the relative entropy functional. 
The definition of the relative entropy is coordinate in- 
dependent and, measuring the state of ignorance rel- 
ative to another given distribution, does not require 
the explicit knowledge of the Jacobian. A maximum- 
entropy principle, which applies to the relative entropy, 
has been formulated in the canonical, non-canonical and 
non-Hamiltonian case. Such a maximum-entropy princi- 
ple may turn out to be relevant for applications in the 
non-Hamiltonian dynamics of non-equilibrium thermo- 



pI 



1 



(Al) 



whose canonical equations of motion can be easily writ- 
ten down. Consider, instead, the following non-canonical 
transformation of coordinates x = (91,92,^1,^2) z — 
(^i,C2,7ri,7r2) defined by 



91 

92 

Pi 

P2 



7r2 • 



(A2) 
(A3) 
(A4) 
(A5) 



By using this transformation of coordinates onto the 
canonical equation of motion, one obtains the following 
non-canonical equations of motion 



?2 = 7^2 

TTl = -^2e2"'7ri+e2"l(C2-eie2"') 
7T2 = -(6-6^2"'). 

The Hamiltonian in non-canonical coordinates is 



H'(z) = e2^^ + f + ^(a?2-^-6)= 



(A6) 
(A7) 
(A8) 
(A9) 

(AlO) 



One can calculate 



dH'jz) 

dH'jz) 
diTi 

dn'{z) 



= C2"'(ae2-'-C2) 
= 6^?-(a?2"'-6)(6?2 



a&T^i 



71'2 



(All) 
1) (A12) 
(A13) 
(A14) 



and write the equations in matrix form 



TTl 
7T2 



1 


-10 

-^1^2' -1 ^1^2' 

d'H'{z)/d^i 

dn'{z)/di2 
dH'{z)/dTri 
dH'{z) /dn2 



^1^2 

1 

-^1^2' 




(A15) 
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Equations (|A6IIA9[) are obviously non-canonical, as it is 
clearly seen by their matrix form given in Eq. (|A15p . and 
they have zero compressibility. Hence, metric theories 
cannot be applied. The antisymmetric matrix appearing 
in Eq. (|A15P must be used to define the non-canonical 
bracket, which obviously satisfies the Jacobi relation and 
the Liouville equation. 



We define the antisymmetric matrix 



'>2 



^2' -^2"'6 

1 







'a -1 



APPENDIX B: A NON-HAMILTONIAN SYSTEM 
WITH ZERO COMPRESSIBILITY 

Let us consider the Hamiltonian of Eq. (jAl[) . We first 
obtain non-canonical equations of motion by considering 
the transformation of coordinates 



qi = 6 a 

92 = £.2 

Pi = TTl 

P2 = 7r2 . 



The Hamiltonian becomes 



-1// _ "1 , "2 I ^2 -, n2 



ni = -6(^1-1) 
6 = -6(1-^1) ■ 



(Bl) 
(B2) 
(B3) 
(B4) 



(B5) 



The non-canonical equations of motion are 

= £2'^! - 6^2^ (B6) 

6 - 7T2 (B7) 



(B8) 
(B9) 



Such non-canonical equations have a compressibility 

AC = -£2^TT2 . (BIO) 



which should be used in order to define the non-canonical 
bracket which satisfies the Jacobi relation. Now, if one 
wants to apply a non-integrable scaling of time in order to 
obtain a non-Hamiltonian flow with zero compressibility 
K, Eq. ([Ff|) can be used. Assuming the scafing function 
^ ^ ^{£2), one obtains 



5$ 
96 



7r2 = C2 



(B12) 



from which one readily finds $ = ^2- Hence, the anti- 



symmetric matrix 3 


= $B 


is 








" 





1 


-61 


B = 











6 


-1 













. 6 


-6 









(B13) 



Non-Hamiltonian equations of motion are now defined 
according to Eq. ([55)1 . Finally, it is not difficult to verify 
that the non-Hamiltonian bracket of Eq. ([5^ . with B 
defined in Eq. (|B13p , docs not satisfy the Jacobi relation 
and Sijk 7^ 0. For example, it is easy to verify that 
<S'314 = 1- 
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